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Foreword 



T his Technical Guide provides complete information on the indicators presented in 

Measuring Up 2002: The State-by-State Report Card for Higher Education. Measuring Up 
2002 is available in full at www.highereducation.org. 

The Technical Guide describes all indicators in Measuring Up 2002, explains the 
methodology used to measure the indicators, and lists the sources of data. The Technical Guide 
was compiled by Mikyung Ryu, policy analyst at the National Center. William Doyle, senior 
policy analyst at the National Center, provided a review. 

The National Center welcomes the comments of readers. 



Joni Finney 
Vice President 

The National Center for Public Policy and Higher Education 



Introduction 



T his Technical Guide describes the methodology and concepts used to measure and grade the 
performance of the 50 states in the higher education arena. 

Part I presents the methodology for grading states and provides information on data 
collection and reporting. Part II explains the indicators that comprise each of the graded 
categories. Specifically, this section details the construction of each indicator — its scope, source, 
and computations. Part III provides data sources for non-graded information, some of which is 
provided in the print edition of Measuring Up 2002, some of which is posted on the on-line 
version of the report card. The non-graded information provides a context for understanding 
graded state performance. 

Data spreadsheets for Measuring Up 2002 can be downloaded from the National Center’s 
Web site at www.highereducation.org, under “Follow-Up Documents,” 

The term higher education is used consistently throughout the Measuring Up series. In this 
context, higher education refers to the postsecondary education and training offered by accredited 
degree-granting colleges and universities that are eligible for Title IV federal financial aid. 

Private for-profit institutions run by employers to provide specific job-related training are not 
included. Unless otherwise noted, the indicators used in Measuring Up 2002 refer to the 
postsecondary education and training through the bachelor’s degree. 



ERIC 



6 



I. Scoring and Grading State Performance 



A. General Methods for Scoring and Grading 

Each of the graded categories contains a number of relevant indicators. These indicators, culled 
from nationally comparable data, represent variables that explain, in part, statewide variation in 
category performance. 

State performance on different indicators is compared through an indexing method in 
which raw scores for each indicator are scaled to the median value of the top five performers. 
This median of best performance is the benchmark for all other states. Each state’s raw scores are 
indexed to (that is, divided by) the benchmark scores on every indicator in every category. 

Once indexed, each state score is multiplied by a predetermined “weight” that accounts for 
the indicator’s relative importance in predicting category performance. The value of each weight 
was determined by existing quantitative research documenting the significance of these variables 
as a measure of category performance. Although some indicators are weighted more heavily than 
other indicators in a category, the sum of all assigned weights totals 100%. At the introduction of 
each category in Part II, the specific weights assigned to each indicator are described. 

In practice, once the value of each indexed indicator is multiplied by the appropriate 
weight, the weighted indexed values are totaled. From these totaled scores, the single best 
performer in the category is identified. The best performer’s overall score in the category is then 
set to 100 and the overall scores of all other states are indexed to this. The exception to this 
process occurs when the best performer’s score is over 100. In that case, the best score is set to 
100 and all other states are indexed to 100. The result is the category index score to which 
alphabetic grades are assigned for each state. The following grading scale is used. 



Grading Scale 



93 and above 


A 


80-82 


B- 


67-69 


D+ 


90-92 


A- 


77-79 


C+ 


63-66 


D 


87-89 


B+ 


73-76 


C 


60-62 


D- 


83-86 


B 


70-72 


C- 


Below 60 


F 
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B. Measuring Improvement Since Measuring Up 2000 



Measuring Up 2002 presents information about whether state performance has improved from 
1998 to 2000, which are the most common data years represented in Measuring Up 2000 and 
Measuring Up 2002. In identifying performance improvement, only those indicators that are 
comparable in both report card editions are selected (see sidebar). 

First, it is determined whether a state’s updated raw score for each indicator in a category 
improved by at least one percent since 
Measuring Up 2000. 

Second, for each indicator showing 
improvement of at least one percent in its 
raw score, predetermined “progress 
points” are awarded. Progress points equal 
the weights of each indicator as defined in 
Measuring Up 2000. The underlying 
rationale is that improvement observed in 
each compared indicator is taken into 
account to the extent that each of these 
indicators is important in predicting 
overall performance in the category. If the 
weights of all compared indicators do not 
total 100% because not all indicators are 
compared, the weights of each compared 
indicator increase in proportion to the 
original weights. For example, if a state’s 
raw score improved in an indicator whose 
original weight was 10% and the totaled 
weights of all compared indicators in the 
category are 90%, then the weight is 
adjusted to 1 1% (10 divided by 90). 

Therefore, the state receives progress 
points of 1 1% in this indicator. 

Finally, the earned progress points 
are added (that is, the weights of all the 
indicators in which the state’s raw scores 
improved by at least one percent are 
added). If these totaled weights are greater 
than 50%, then the state’s performance in 
the category is considered as “improved” 
since Measuring Up 2000\ that is, with the 



Indicators Used to Measure Improvement 

Not all indicators in Measuring Up 2000 and Measuring 
Up 2002 are comparable, due to the use of new 
indicators and refinements in methodology. The following 
indicators were used to measure improvement: 

Preparation 

High school credential 
Math course taking 
Science course taking 
Algebra in 8^^ Grade 
Math proficiency 

Math proficiency among low-income 
College entrance exams 
Advanced Placement exams 

Participation (all indicators were used in this category) 

High school to college rate 
Young adult enrollment 
Working-age adult enrollment 

Affordability 

Family ability to pay at community colleges 
Family ability to pay at public 4-year colleges 
Family ability to pay at private 4-year colleges 
Need-based financial aid 
Low-priced colleges 

Completion 

Students returning at community colleges 
Students returning at 4-year colleges 
Bachelor’s degree completion in 5 years 
All degree completion 

Benefits 

Adults with bachelor’s degree or higher 
Increased income from bachelor’s degree 
Population voting 
Charitable contributions 
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weights of the indicators taken into account, the state has improved on the “majority” of 
measures. The same procedure is followed for all five categories. 

This method applies only when data are available for a state for both years. For a state with 
missing data for certain indicators, performance improvement is determined based on all 
available data for the state, after adjusting the indicator weights proportionately based on the 
original size of weights. 

C. Currency of Data 

The Measuring Up series includes the most recent data available. Unfortunately, collecting 
agencies often require months to analyze and disseminate reports to the public. Additionally, in 
some cases, data are not systematically collected each year. Finally, it is possible that future 
assessments or studies have not received authorization or funding for subsequent data collection. 
For one or more of these reasons, state results on the report card’s indicators may lag behind 
recent changes or incompletely capture the most recent initiatives that state policymakers have 
implemented. 

D. Missing Data 

Like Measuring Up 2000, Measuring Up 2002 uses reliable and comparable state-by-state data. 
Despite the scientific survey methods used to collect this data, information cannot always be 
reported reliably for each state because many national surveys do not oversample populations 
from every state. Thus, estimates of the behaviors, characteristics, or educational performance of 
the populations in small states are often not captured adequately by nationally drawn random 
samples. In cases of nationally administered surveys such as the National Assessment of 
Educational Progress (NAEP), states are given the option to participate in a state oversample and 
may decline to take part. 

Measuring Up 2002 includes some indicators in which data are missing for more than one 
state; such indicators were retained because they reflect salient policy issues and signal the 
necessity to expand formal data collection to all 50 states. 

Data imputation 

To adjust for missing data, several strategies were considered and discarded. Choosing to assign a 
zero value to states that did not report data on specific indicators presumes the lowest possible 
performance. Alternatively, relying on the mean value of all states’ performance presumes 
similarity between states that are in fact quite distinct. Calculating a grade using only available 
data distorts the weighting method applied because indicators with data become more important 
than those without data in the calculation of the overall grade, regardless of their overall influence 
in determining category performance. 
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Consequently, where no comparable data exist to gauge a state’s performance on an 
individual indicator, a technique known as imputation is applied. This strategy calculates the 
weighted mean value of state performance on indicators within a given category for which data 
are available for the state and applies that value where data are otherwise missing. This technique 
is applied to every state with missing data, using the weighted mean score of the state’s own 
performance on other indicators. Imputing in this way presumes the state does neither better nor 
worse on an indicator for which it is missing data than it does on highly correlated indicators 
within the same category. 

Latest data available 

In cases where some states did not participate in the most recent survey, although they had 
previously participated, the report card applies the latest data available principle. This means 
that, to calculate the final grade, states’ raw scores on each indicator are derived from the most 
recent survey that they participated in, not necessarily the most recently administered survey. 
Therefore, for several states, Measuring Up 2002 uses the scores from the previous report card. In 
Part II, where data availability is noted for each indicator, the states are identified for which 
Measuring Up 2002 uses previous data. 

Accuracy of data 

An estimate derived from a sample rather than the entire population can vary, depending on 
different sample populations. Standard error is a measure of the variability among all possible 
samples. The accuracy of an estimate decreases with larger standard error. When state estimates 
are produced with a large standard error, the estimates are unlikely to be precise. Therefore, the 
report card applies the rule that an estimate with a standard error of 10 percentage points or 
greater is not reliable and is considered as missing data. In such cases, the state score is based on 
data used in the previous report card, or on an imputed value if previous data are unavailable. 

E. Migration 

Migration of students and college graduates is a critical component of state performance in many 
of the categories. Although indicators in the educational benefits and participation categories 
would do well to adjust for migration, this type of detailed analysis is simply not possible at the 
state level, given current practices of data collection. Unless otherwise noted, population changes 
resulting from inter-state migration cannot be accounted for in this report card due to data 
limitations. 
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II. Graded Performance Categories 



S ix overall categories are used in the Measuring Up series to gauge state higher education 
performance: preparation, participation, affordability, completion, benefits, and learning. As 
in Measuring Up 2000, all states again receive an Incomplete in learning because states lack 
information on the educational performance of college students that would permit systematic 
state-by-state comparisons. 

In Measuring Up 2002, four new indicators have been introduced and a few existing 
indicators are now calculated with more refined methodologies. The new indicators and revised 
methodologies are described in this section. 

The following pages detail each of the performance categories, describing the indicators 
and the indicator weights used to calculate states’ grades. Also presented is a comprehensive 
catalogue of data sources, indicating collecting agency and periodicity. 
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A. Preparation 



The preparation category identifies several related factors contributing to the preparation of 
students for higher education. The 12 indicators in preparation, including two new ones, are 
grouped into three clusters. 



Preparation: Indicators and Weights 


Indicator 


Weight 


Cluster 1; High School Completion 


20% 


18- to 24-year-olds with a high school credential 


20% 


Cluster 2: K-1 2 Course Taking 


40% 


giti to 12“' graders taking at least one upper-level math course 


10% 


gth to 12'“ graders taking at least one upper-level science course 


15% 


8'“ grade students taking algebra 


10% 


12“’ graders taking at least one upper-level math course 


5% 


Clusters: K-1 2 Student Achievement 


40% 


8*^ graders scoring at or above “proficient” on the national assessment exam in math 


4% 


graders scoring at or above “proficient” on the national assessment exam in reading 


4% 


8^^ graders scoring at or above “proficient” on the national assessment exam in science 


4% 


8^^ graders scoring at or above “proficient” on the national assessment exam in writing i 


4% 


Low-income 8*^ graders scoring at or above “proficient” on the national assessment exam in math 


4% 


Number of scores in the top 20% nationally on SAT/ACT college entrance exam per 1 ,000 high 
school graduates 


10% 


Number of scores that are 3 or higher on an Advanced Placement subject test per 1 ,000 high 
school juniors and seniors 


10% 



best copy available 





HIGH SCHOOL COMPLETION: 

18- to 24-year-olds with a high school credential 



Source 

U.S. Bureau of the Census. Current Population Survey, October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 



Description 

This measure uses the following calculation: 

■ Numerator: Number of 1 8- to 24-year-olds in the population holding a high school 
credential.* 

■ Denominator: Total population ages 1 8 to 24, excluding those still enrolled in high 
school or currently pursuing alternative certification. 

* High school credential includes a high school diploma or alternative certification such as a 
General Educational Development (GED) diploma. 

Notes 

This indicator measures the extent to which the young adult population in the state is minimally 
certified to participate in the workforce and participate in postsecondary education. This indicator 
is not a calculation of the percentage of students graduating from high school in four years. Given 
the drop-out and re-entry patterns of many students, a simple calculation of high school 
graduation rate would fail to capture their eventual completion. 

Data availability 

This indicator pools three years of the most current data, 1998 to 2000, to obtain a large enough 
sample size to make reliable state estimates and to account for aberrations in any single year of 
data. Using this method, data are available for all 50 states. 
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K-12 COURSE TAKING: 

9“* to 12“* graders taking at least one upper-level math course 
Source 

Rolf K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 
2001: State-by-State Trends and New Indicators from the 1999-2000 School Year. Washington, 
D.C.: Council of Chief State School Officers, 2002, p. 43. 

Description 

This indicator measures the percentage of public high school students in the state in grades 9 to 
12 who took one or more math courses at levels 2 through 5 during the 1999-2000 school year. 
These math courses include geometry, algebra 2, integrated math 3, trigonometry, pre-calculus, 
calculus, and AP calculus. 

Note 

Although high school course taking in humanities is also important to students’ preparation, 
neither the Council of Chief State School Officers (CCSSO) nor any other organization collects 
this type of comparative data from the states. 

Data availability 

Data are available for 32 states— including Delaware and Michigan, for which the latest data 
available method was applied (that is, their previous data, from Measuring Up 2000, were used 
because they did not participate in the most recently administered survey). 

States for which data are unavailable are: Alaska, Arizona, Colorado, Florida, Georgia, 
Hawaii, Illinois, Kansas, Maine, Maryland, Montana, New Hampshire, New Jersey, 
Pennsylvania, Rhode Island, South Carolina, Virginia, and Washington. 
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K-12 COURSE TAKING: 

9 “* to 12“’ graders taking at least one upper-level science course 

Source 

Rolf K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 
2001: State-by-State Trends and New Indicators from the 1999-2000 School Year. Washington, 
D.C.: Council of Chief State School Officers, 2002, p. 44. 

Description 

A separate but similar indicator to math course taking, science course taking measures the extent 
to which students in the state were enrolled in one or more of the following science courses 
during the 1999-2000 school year: all courses in chemistry or physics, second-year biology, AP 
biology, second-year earth science, or other advanced science courses. 

Note 

Although high school course taking in humanities is also important to students’ preparation, 
neither the CCSSO nor any other organization collects this type of comparative data from the 
states. 

Data availability 

Data are reported for 32 states — including Delaware and Michigan, for which the latest data 
available method was applied (that is, their previous data, from Measuring Up 2000, were used 
again because they did not participate in the most recently administered survey). 

States for which data are unavailable are: Alaska, Arizona, Colorado, Florida, Georgia, 
Hawaii, Illinois, Kansas, Maine, Maryland, Montana, New Hampshire, New Jersey, 
Pennsylvania, Rhode Island, South Carolina, Virginia, and Washington. 
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K-12 COURSE TAKING: 

8“' grade students taking algebra 

Source 

Rolf K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 
2001: State-by-State Trends and New Indicators from the 1999-2000 School Year, Washington, 
D.C.: Council of Chief State School Officers, 2002, p. 46. 

Description 

This indicator measures the percentage of public school grade students in the state who took 
algebra 1 during the 1999-2000 school year. 

Data availability 

Data are available from 30 states — including Delaware, Michigan, and New York, for which the 
latest data available method was applied (that is, their previous data, from Measuring Up 2000, 
were used again because they did not participate in the most recently administered survey). 

States for which data are unavailable are: Alaska, Arizona, Colorado, Florida, Georgia, 
Hawaii, Illinois, Iowa, Kansas, Maine, Maryland, Montana, New Hampshire, New Jersey, 
Pennsylvania, Rhode Island, South Carolina, Texas, Virginia, and Washington. 
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K-12 COURSE TAKING: 

12^^ graders taking at least one upper-level math course 

Source 

Calculations based on unpublished data provided by Science and Math Indicator Project Team at 
Council of Chief State School Officers. The data are from the same source that was used for: Rolf 
K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 2001: 
State-by-State Trends and New Indicators from the 1999—2000 School Year. Washington, D.C.: 
Council of Chief State School Officers, 2002. 

Description 

This newly added indicator measures the percentage of public high school seniors in the state 
who took at least one advanced math course during the 1999-2000 school year. In recent years, 
much attention has been paid to the problem of America’s high school seniors. The indicator 
provides a current status check on how many high school students maintain academic rigor during 
their last year. Students tend not to take academically demanding courses after college acceptance 
and thus their preparation for postsecondary education or the workforce may decline. In order to 
ensure that more students are ready for a successful transition, state policies requiring more 
rigorous course enrollment throughout all high school years are suggested. 

The indicator uses the following calculation: 

■ Numerator: Number of public high school seniors enrolled in math courses at levels 2 
through 5* during the 1999-2000 school year. 

■ Denominator: Number of public high school seniors enrolled for the 1999-2000 
school year. 

* These courses include geometry, algebra 2, integrated math 3, trigonometry, pre-calculus, 
calculus, and AP calculus. 

Data availability 

Data are reported for 16 states. Many states are missing data because they declined to participate 
in the survey, or they did not report course enrollments by grade level. 

States for which data are unavailable are: Alaska, Arizona, Colorado, Delaware, Florida, 
Georgia, Hawaii, Illinois, Iowa, Kansas, Kentucky, Louisiana, Maine, Maryland, Massachusetts, 
Michigan, Minnesota, Mississippi, Missouri, Montana, Nebraska, Nevada, New Hampshire, New 
Jersey, New York, Ohio, Oklahoma, Oregon, Pennsylvania, Rhode Island, South Carolina, 
Tennessee, Virginia, and Washington. 
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K-12 STUDENT ACHIEVEMENT: 

8*** graders scoring at or above “proficient” on the national assessment exam in 
math 

Source 

National Assessment of Educational Progress. The Nation 's Report Card, Mathematics 2000. 
Washington, D.C.; U.S. Department of Education. 
http://nces.ed.gov/nationsreportcard/mathematics/ (accessed 2/15/02). 

Description 

These proficiency rates describe the percentage of graders enrolled in public school whose 
performance on the National Assessment of Educational Progress (NAEP) exam in math was 
“proficient” or “advanced.” 

Note 

Academic proficiency levels are determined by the National Assessment Governing Board, based 
on judgments about what students should know and be able to do. 

Data availability 

Thirty-nine states participated in the 2000 assessment. Measuring Up 2002 reports 7 more states 
in addition to the 39 participating states, by using the latest data available method (that is, using 
the 1996 assessment data, as reported in Measuring Up 2000, for the states that did not participate 
in the 2000 assessment). These additional 7 states are Alaska, Colorado, Delaware, Florida, Iowa, 
Washington, and Wisconsin. 

States for which data are unavailable are New Hampshire, New Jersey, Pennsylvania, and 
South Dakota. 
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K-^12 STUDENT ACHIEVEMENT: 

8^^ graders scoring at or above ^^proflcienf’ on the national assessment exam in 
reading 

Source 

National Assessment of Educational Progress. 1998 National and State Reading Summary Data 
Tables for Grade 8 Student Data. Washington, D.C.: U.S. Department of Education, 1998. 

Description 

These proficiency rates describe the percentage of 8^ graders enrolled in public school whose 
performance on the National Assessment of Educational Progress (NAEP) exam in reading was 
“proficient” or “advanced.” 

Notes 

Academic proficiency levels are determined by the National Assessment Governing Board, based 
on judgments about what students should know and be able to do. The reading assessment is 
usually conducted every four to five years, and the 1998 assessment that was reported in 
Measuring Up 2000 is still the most recent. Therefore, the reading data could not be updated for 
Measuring Up 2002. 

Data availability 

Thirty-six states participated in the 8^^ grade reading assessment. States for which data are 
missing are: Alaska, Idaho, Illinois, Indiana, Iowa, Michigan, Nebraska, New Hampshire, New 
Jersey, North Dakota, Ohio, Pennsylvania, South Dakota, and Vermont. 
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K^12 STUDENT ACHIEVEMENT: 

8^** graders scoring at or above ‘‘proficient” on the national assessment exam in 
science 

Source 

National Assessment of Educational Progress. The Nation 's Report Card, Science 2000. 
Washington, D.C.: U.S. Department of Education, http://nces.ed.gov/nationsreportcard/science/ 
(accessed 11/21/01). 

Description 

This new indicator measures the percentage of 8* graders enrolled in public school whose 
performance on the National Assessment of Educational Progress (NAEP) exam in science was 
“proficient” or “advanced.” 

Note 

Academic proficiency levels are determined by the National Assessment Governing Board, based 
on judgments about what students should know and be able to do. 

Data availability 

Thirty-eight states participated in the 2000 assessment and are reported in Measuring Up 2002. 

States for which data are missing are: Alaska, Colorado, Delaware, Florida, Iowa, Kansas, 
New Hampshire, New Jersey, Pennsylvania, South Dakota, Washington, and Wisconsin. 




15 



20 



K-12 STUDENT ACHIEVEMENT: 

8th graders scoring at or above “proficient” on the national assessment exam in 
writing 

Source 

National Assessment of Educational Progress. 1998 National and State Writing Summary Data 
Tables for Grade 8 Student Data. Washington, D.C.; U.S. Department of Education, 1998. 

Description 

This measure describes the percentage of 8* graders enrolled in public school whose performance 
on the National Assessment of Educational Progress (NAEP) exam in writing was “proficient” or 
“advanced.” 

Notes 

Academic proficiency levels are determined by the National Assessment Governing Board, based 
on judgments about what students should know and be able to do. The writing assessment is 
conducted every four to five years, and the 1998 assessment that was reported in Measuring Up 
2000 is still the most recent. Therefore, the writing proficiency data could not be updated for 
Measuring Up 2002. 

Data availability 

Thirty-five states participated in the 8* grade writing assessment. States for which data are 
missing are: Alaska, Idaho, Illinois, Indiana, Iowa, Kansas, Michigan, Nebraska, New Hampshire, 
New Jersey, North Dakota, Ohio, Pennsylvania, South Dakota, and Vermont. 
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K-12 STUDENT ACHIEVEMENT 

Low-income 8^** graders scoring at or above “proficient” on the national assessment 
exam in math 

Source 

National Assessment of Educational Progress. The Nation 's Report Card, Mathematics 2000. 
Washington, D.C.: U.S. Department of Education. 
http://nces.ed.gov/nationsreportcard/mathematics/ (accessed 2/15/02). 

Description 

This indicator describes the percentage of public school 8^^ graders who are eligible for free or 
reduced-price lunch and whose performance on the National Assessment of Educational Progress 
(NAEP) exam in math was “proficient” or “advanced.” 

Note 

Academic proficiency levels are determined by the National Assessment Governing Board, based 
on judgments about what students should know and be able to do. 

Data availability 

Thirty-nine states participated in the 2000 math assessment. Measuring Up 2002 reported four 
additional states, using the latest data available method (that is, for those that did not participate 
in the 2000 assessment. Measuring Up 2002 uses the 1996 assessment data as reported in 
Measuring Up 2000). These states are: Colorado, Delaware, Florida, and Washington. 

States for which data are unavailable are: Alaska, Iowa, New Hampshire, New Jersey, 
Pennsylvania, South Dakota, and Wisconsin. 
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K-12 STUDENT ACHIEVEMENT: 

Number of scores in the top 20% nationally on SAT/ACT college entrance exam per 
1,000 high school graduates 

Sources 
Test Scores 

The College Board. “2001 SAT V+M Score Bands Report,” unpublished report, New York, 

2001. 

ACT. “Percent of 2001 High School Graduates with ACT Composite Scores of 26 or Higher,” 
unpublished analysis, Iowa City, Iowa, 2001. 

2000-2001 Public and Private High School Graduates (projections) 

Western Interstate Commission for Higher Education. Knocking at the College Door: Projections 
of High School Graduates by State and Race/Ethnicity, 1996-2012. Boulder, CO: 1998. 

Conversion 

Gary L. Marco, et. al. Methods Used To Establish Score Comparability on the Enhanced ACT 
Assessment and the SAT. New York: College Board, 1992. 

Description 

This indicator reflects the prevalence of four-year college test-taking throughout the state as well 
as the achievement that student test takers demonstrate. College entrance exam achievement is 
calculated per 1,000 high school graduates in each state, using the following formula: 

■ Numerator: (Number of public and private high school seniors scoring at or above 
1200 on the SAT test) + (number of public and private high school seniors scoring at 
or above 26 on ACT test). 

■ Denominator: Number of public and private high school graduates for the 2000—01 
school year. 

Notes 

Nationally, 18% of test-takers scored at or above 1200 on the SAT in 1999. Students attaining 
this score or higher approximate the top quintile (20%) of SAT test takers. Though the ACT 
exams are administered independently and use a different scoring methodology than that used by 
the College Board for SAT scores, a common conversion method can be applied. A score of 26 
on the ACT exam is equivalent to a score of 1200 on the SAT exam. 

The National Educational Longitudinal Study of 1988 (NELS) indicates that 15% of high 
school seniors take both the SAT and the ACT, although data are not collected in such a way as to 
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provide an unduplicated count of test takers. This ratio does not provide information on the 
number of students in each state who take college preparatory exams. Instead, the numerator 
measures the total number of scores at or above 1200 on the SAT and 26 on the ACT. 
Constructed this way, the measure accounts for individual students who perform proficiently on 
more than one college entrance exam. 

Data availability 

Data are available for all 50 states. 
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A-/2 STUDENT ACHIEVEMENT: 

Number of scores that are 3 or higher on an Advanced Placement subject test per 
1,000 high school juniors and seniors 



Source 

The College Board. 2001 State and National Annual Summary Reports. New York: The College 
Board, http://www.collegeboard.com/ap/library/state_nat_rpts_01.html (accessed 6/14/02). 

Description 

This indicator measures the number of Advanced Placement subject tests taken by 1 1^ and 12^ 
grade students with scores of 3 or higher per 1,000 11^ and 12^^ grade students enrolled in public 
and private schools. The measure uses the following calculation: 

■ Numerator: Number of 1 1^^ and 12^ graders’ Advanced Placement subject test scores 
of 3, 4, or 5. 

■ Denominator: Total 1 1‘^ and 12‘^ graders enrolled in public and private schools.* 

* The number of 1 and 12^^ graders enrolled in public and private schools was computed by 
multiplying the public enrollment by a private-enrollment adjustment factor developed by a data 
contractor working with the College Board. The total 1 and 12* grade enrollment in the state 
is used because the majority of AP test-takers (88% in 2001) were enrolled in these grades. 



Notes 

This ratio does not provide information on the number of students in each state who take an 
Advanced Placement test. Instead, the numerator measures the total number of scores at or above 
3. Constructed this way, the measure accounts for individual students who perform proficiently 
on more than one AP subject test. Scores at or above 3 are generally recognized for college credit. 

Opportunities other than AP exist for high school students to take college-level courses, 
including the International Baccalaureate (EB) program and college concurrent enrollment 
programs. The Advanced Placement program offered by the College Board is the most prevalent 
in U.S. high schools and the most widely recognized for credit by policymakers and colleges and 
universities. 

Data availability 

Data are available for all 50 states. 



B. Participation 



The participation category assesses the opportunities in each state for residents of varying ages 
and income levels to enroll in postsecondary education. 

To broadly assess state performance in this category, various enrollment patterns and 
institution types are considered. These include full- and part-time enrollment at both two- and 
four-year institutions, and public and private colleges. Due to the lack of nationally comparable 
data, however, participation in non-accredited institutions, corporate or employer-sponsored 
education or training programs is not included. 

The three indicators in participation are divided into two clusters. 



Participation; Indicators and Weights 


Indicator 


Weight 


Cluster 1: Young Adults 


60% 


High school freshmen enrolling in college within 4 years in any state 


40% 


18- to 24-year-olds enrolling in college 


20% 


Cluster 2: Working-Age Adults 


40% 


25- to 49-year-olds enrolled part-time in some type of postsecondary education 


. 40% 



best copy available 




YOUNG ADULTS: 

High school freshmen enrolling in college within 4 years in any state 

Source 

Thomas Mortenson. “Chance for College by Age 19 by State in 1998.” Postsecondary Education 
Opportunity. No. 98, August 2000. http://www.postsecondary.org (accessed 1 1/5/01). 

Description 

This indicator measures the probability that students will go on to college during the year 
immediately following an on-time high school graduation (that is, when most students are 
approximately age 19). To calculate this measure, the high school completion rate is multiplied 
by the college continuation rate. The following formulas describe the components of this 
calculation: 

High School Completion Rate* 

■ Numerator: Number of public high school graduates in 1998. 

■ Denominator: Number of public school ninth graders in 1994. 

College Continuation Rate* 

■ Numerator: Number of college freshmen in 1998. 

■ Denominator: Number of public high school graduates in 1998. 

* Data are from National Center for Education Statistics, Washington, D.C.: U.S. Department of 
Education. 

This indicator adjusts for migration by using the NCES residence and migration survey, 
which followed high school graduates to the institutions they chose to attend. Since many 
students pursue their college education out-of-state, the calculation related college freshmen by 
state of residency to the state data on high school graduates. 

Notes 

This is a synthetic cohort statistic that cannot adjust for students’ out-of-state migration during the 
high school years. No nationally comparable longitudinal data exist that precisely measure the 
college-going rate of 9^ grade students in each state. 

Data availability 

Data are available for all 50 states. 
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YOUNG ADULTS: 

18- to 24-year-olds enrolling in college 
Source 

U.S. Bureau of the Census. Current Population Survey, October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Description 

This indicator reports the percentage of all 18- to 24-year-old high school graduates enrolled 
either full-time or part-time in postsecondary education. The measure uses the following 
calculation: 

■ Numerator: Total population of adults ages 18 to 24 enrolled in grades 13 to 17 who 
have not yet attained baccalaureate degrees. 

■ Denominator: Total population ages 18 to 24. 



Note 

Students already holding a baccalaureate degree and returning for additional or different 
credentials are not included in this figure. 

Data availability 

This indicator pools three years of the most current data, 1998 to 2000, to obtain a large enough 
sample size to make reliable state estimates and to account for aberrations in any single year of 
data. Data are available for all 50 states. 
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WORKING-A GE ADULTS: 

25- to 49-year-olds enrolled part-time in some type of postsecondary education 



Sources 

Population Enrolled 

National Center for Education Statistics. ‘Tall Enrollment Survey, 1999-2000,” unpublished 
tabulation provided by Tom Snyder at NCES, U.S. Department of Education, Washington, D.C. 

Population 

U.S. Bureau of the Census. Current Population Survey, October 1999 Supplement. Washington, 
D.C. State-level data provided by Pinkerton Computer Consultants, 2002. 

Description 

This indicator measures the percentage of 25- to 49-year-old high school graduates enrolled part- 
time in an institution of higher education. The following calculation is used: 

■ Numerator: Population of adults ages 25 to 49 with at least a high school credential 
who are enrolled part-time in an institution of higher education. 

■ Denominator: Population of adults ages 25 to 49 with at least a high school 
credential. 

Notes 

This indicator focuses on part-time enrollment to assess the opportunities in each state to enroll 
part-time in postsecondary education. It includes both undergraduate- and graduate-level 
enrollments. 

The indicator measures the 25- to 49-year-old adult population, which is slightly different 
from the 25- to 44-year-old population reported in Measuring Up 2000. This is due to differences 
in data collection methods that in 2000 did not permit an exact age-match between the numerator 
and the denominator. This problem has since been resolved, enabling us to measure exactly the 
same-age population in 2002. The slight age difference in the denominator in the 2002 report 
compared with the 2000 report does not generate significant changes to the final ratios. 

Data availability 

Data are available for all 50 states. 




24 

29 



C. Affordability 



Affordability of higher education is based on three concepts: 

■ students’ capacity to pay for college, given the type of institution they attend, the 
financial aid they receive, and their income constraints; 

■ the amount of need-based grant assistance they receive to offset expenses; and 

■ the loan burden associated with their higher education expenses. 

The six indicators included in this category combine data from a variety of sources. 
Together, they calculate a reasonable estimate of the actual amount that people in a state pay for 
higher education as well as the extent to which states employ policies to make college education 
more affordable. 

No comprehensive, student-level, comparable state data capturing price of attendance for 
higher education currently exist. This category uses best estimates to assess the extent to which 
college is affordable for residents of varying income levels in each state. 



Affordability: Indicators and Weights 



Indicator 


Weight 


Cluster 1: Family ability to pay 


50% 


Percent of income (average of all income groups) needed to pay 
for college expenses minus financial aid at community colleges 


Weighted by student enrollment in sector 


Percent of income (average of all income groups) needed to pay 
for college expenses minus financial aid at public 4-year 
; colleges/universities 


Weighted by student enrollment in sector 


Percent of income (average of all income groups) needed to pay 
for college expenses minus financial aid at private 4-year 
colleges/universities 


Weighted by student enrollment in sector 


Cluster 2: Strategies for affordability 


40% 


State grant aid targeted to low-income families as a percent of 
federal Pell Grant aid to low-income families 


20% 


Share of income that poorest families need to pay for tuition at 
lowest-priced colleges 


20% 


Cluster 3; Reliance on loans 


10% 


Average loan amount that undergraduate students borrow each 
year 


10% 



BEST COPY AVAILABLE 



FAMIL Y ABILITY TO PA Y: 

Percent of income (average of all income groups) needed to pay for college expenses 
minus financial aid: 

at community colleges 

at public 4-year colleges/universities 

at private 4-year colleges/universities 

Sources 

Tuition and room and board 

National Center for Education Statistics. Digest of Education Statistics 2001. Washington, D.C.: 
U.S. Department of Education, 2002, p. 361. 

Pell Grants 

Office of Postsecondary Education. Title IV/Pell Grant End of the Year Report, 2000— 2001 . 
Washington, D.C.: U.S. Department of Education, 2002, Table 21. 

Institutional aid 

Sam Barbett and Roslyn Korb. Current Fund Revenues and Expenditures of Degree Granting 
Institutions, Fiscal Year 1996. Washington, D.C.: National Center for Education Statistics, U.S. 
Department of Education, 1999, Tables 10, 11, and 12. 

Family income by quintile 

U.S. Bureau of the Census. Current Population Survey, March 1999, 2000, and 2001 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Grant phase-out information 

National Center for Education Statistics. National Postsecondary Student Aid Survey, 1999. 
Washington, D.C.: U.S. Department of Education. Data Analysis System Variables: PELLAMT, 
INSTAMT, STATNEED, STATNOND, TOTGRT By CINCOME. Filtered by institution level 
and control for public two-year, public four-year, and private four-year institutions. 

State grants (need- and non-need-based) 

Kristen DeSalvatore. National Association of State Student Grant and Aid Programs 32” Annual 
Survey, 2000-2001 Academic Survey Report. Albany, NY: National Association of State Student 
Grant and Aid Programs, 2002, Table 1 . 
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Full-time equivalent enrollment 

National Center for Education Statistics. Digest of Education Statistics 2001. Washington, D.C.: 
U.S. Department of Education, 2002, p. 236. 

Consumer Price Index 

Bureau of Labor Statistics. Consumer Price Index 1996-2001. Washington, D.C.: U.S. 
Department of Labor, http://www.bls.gov (accessed 5/13/02). 

Description 

College affordability is based on institutional price, the adequacy of state effort to meet students’ 
financial need, and students’ personal or family income. The family ability-to-pay cluster of 
indicators examines the interaction of these important factors given (1) the variation in personal 
income that families of different means must pay to meet college costs, and (2) the variations in 
price across the public/private and two- and four-year sectors. 

To assess state performance reliably and comparably, this indicator is based on a set of 
assumptions and a series of calculations that use a combination of national and state-level data. 
The first set of calculations determines the approximate net price of college attendance, taking 
into account federal, state, and institutional financial aid. The second set of calculations relates 
this net price to families’ annual income and takes into account the share of total enrollment at 
each of the major sectors in higher education: public two-year colleges, public four-year colleges 
and universities, and private four-year colleges and universities. 

Components of net price 
Tuition and fees 

The average tuition and fees (for in-state residents) are calculated by state for each of the major 
sectors in higher education: public two-year colleges, public four-year colleges and universities, 
and private four-year colleges and universities. This calculation assumes average tuition and fees 
for each sector charged to the full-time student. 

Room and board 

The federal government adds the price of housing, food and other necessary living expenses to 
tuition and fees when determining a student’s price of attendance at a particular institution. This 
indicator calculates average room and board fees by state and by type of institution. This 
calculation assumes that average cost of living expenses at public four-year colleges in the state 
are the same as incurred by students attending the state’s public two-year community colleges. 
This assumption is made in part to account for living expenses that must be paid by all students, 
regardless of whether they live on campus or not. 
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Federal Financial aid 

Average federal financial aid by state is calculated as the average Pell Grant per full-time 
equivalent enrollment (FTE), by state. Pell Grants are by far the largest component of federal 
grant aid. 

State financial aid 

States offer need-based and non-need-based financial aid for college attendance. Separate need- 
based and non-need-based awards are calculated per FTE. 

Institutional Financial aid 

Institutions offer scholarships, fellowships, and tuition discounts to support undergraduate college 
attendance. Average institutional financial aid by state is calculated per FTE. 

Average financial aid by family income 

Average financial aid awards mask the deliberateness of policies to target aid at different student 
populations. Without student unit records available at the state level to provide precise estimates 
of financial aid received, estimates must be calculated. These estimates are based on the 
distribution of financial aid received by students, nationally, in each income quintile. For each 
type of major financial aid (federal, state, institutional), the U.S. Department of Education’s 
National Postsecondary Student Aid Survey estimates the percent of total aid received by full- 
time equivalent students in each state. These national percentages are multiplied by the average 
federal, state and institutional awards described above. These calculations assume that students 
receive the same percentage of available aid in every state, but the actual amount of financial aid 
for students in each income quintile will vary by state because the size of the average award 
varies by sector and by state. These calculations do not take these state variations into account. 

Net price in each sector 

Average net price of attendance in the major sectors of higher education is calculated by 
subtracting total average financial aid (federal + state + institutional) from average expenses 
(tuition + fees + room + board). While expenses do not vary for students with different family 
incomes, average financial aid is different for each family income quintile in the state. 

The role of family income 

Paying for college is based both on the net price and the resources available to pay the price. By 
state, net price at each of the major sectors is calculated as a percentage of median family income 
in each quintile. The results of these calculations are estimates of the amount of family income 
required by low-income, middle-income and high-income families to attend college in each of the 
state’s major sectors. 
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To estimate affordability for all families in each sector, ability to pay is estimated for 
families in each income quintile. The average of these five estimates is used to determine the 
following: 

■ average ability to pay for a technical or community college, all families in the state; 

■ average ability to pay for a public four-year college or university, all families in the 
state; and 

■ average ability to pay for a private four-year college or university, all families in the 
state. 

These three measures are cumulatively worth 50% of the state’s affordability grade, but the 
weight assigned to each differs by the share of total full-time equivalent enrollment each sector in 
the state comprises. This final step ensures that college affordability is determined not only by the 
state’s efforts to make one sector affordable for all of its residents, but also by the state’s policies 
to make its most-utilized institutions affordable. 

Notes 

The most precise way to measure students’ ability to pay would be to analyze student-unit record 
data. While such records are available for national indicators of affordability, it is not possible to 
develop reliable and comparable indicators from these sources that attest to the level of 
affordability in each of the 50 states. 

Comparable income data on the students enrolled in each sector are not available by state. 
As a result, this calculation measures the ability of all state residents to pay for college, regardless 
of whether or not they enroll in a postsecondary institution. 

Beginning with Measuring Up 2002^ the state financial aid data used to calculate the net 
price include only the aid awarded to undergraduates. 

An unduplicated count of students who receive state or institutional financial aid awards is 
not available. As a result, the average award likely underestimates the mean value of awards any 
single student might actually receive. 

It is the institution’s discretion to report tuition waivers and/or discounting in its estimation 
of total scholarships and fellowships, so the average institutional grant may underestimate actual 
aid received. 

Data availability 

Data are available for all 50 states. 
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STRA TEGIES FOR AFFORDABILITY: 

State grant aid targeted to low-income families as a percent of federal Pell Grant aid 
to low-income families 

Sources 
Pell Grants 

Office of Postsecondary Education. Title IV/Pell Grant End of the Year Report, 2000— 2001 . 
Washington, D.C.: U.S. Department of Education, 2002, Table 21. 

State grants 

Kristen DeSalvatore. National Association of State Student Grant and Aid Programs 32nd Annual 
Survey, 2000-2001 Academic Survey Report. Albany, NY: National Association of State Student 
Grant and Aid Programs, 2002, Table 1. 

Description 

This indicator measures each state’s commitment to provide aid for low-income students, through 
the following formula: 

■ Numerator: Total amount of state need-based aid awarded to students. 

■ Denominator: Distribution of Pell Grant aid by state of residence of students. 

Without having data to measure precisely the expected family contribution and amount of 
unmet need for students in each state, this indicator is a proxy measure for (1) how well the state 
targets aid to families with the greatest need, and (2) how much need-based aid is made available 
to all students. 

Notes 

It is assumed that the state’s methodology for awarding state need-based aid is similar enough to 
the federal methodology that the students awarded need-based aid in the state are the same 
students covered by the federal Pell Grant program. This may or may not be true in all cases. Due 
to data limitations, whether or not the two types of financial aid are actually going to the same 
students cannot be determined. 

Beginning with Measuring Up 2002, the state grant data used include only the awards 
given to undergraduate students. 

Data availability 

Data are available for all 50 states. 
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STRA TEGIES FOR AFFORDABILITY: 

Share of income that poorest families need to pay for tuition at lowest-priced 
colleges 



Sources 

Tuition 

National Center for Education Statistics. Digest of Education Statistics 2001. Washington, D.C.: 
U.S. Department of Education, 2002, p. 361. 

Family income for the lowest quintile 

U.S. Bureau of the Census. Current Population Survey, March 1999, 2000, and 2001 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Description 

Tuition levels have been shown to affect whether low-income students choose to go to college. 
Overall tuition levels are an important part of the concept of affordability. This indicator 
measures this aspect of affordability with the following formula: 

■ Numerator: The listed tuition and fees for full-time residents at the lowest-priced 
public institutions in the state. 

■ Denominator: State median family income in the lowest-income quintile. 



Notes 

The lowest-priced tuition level reflects prices at community colleges. This indicator averages 
three years of family income data from the most current data available (1999 to 2001) to obtain a 
large enough sample size to make reliable state estimates and to account for aberrations in any 
single year of data. 

Data availability 

Data are available for all 50 states. 
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RELIANCE ON LOANS: 

Average loan amount that undergraduate students borrow each year 



Sources 
FFELP loans 

National Center for Education Statistics. FFELP Report, AY 2000-01: Total Loan Guarantees for 
Undergraduates Only. Washington, D.C.: U.S. Department of Education, 2001. 

Direct loans 

National Center for Education Statistics. Direct Loans to Undergraduates, AY 2000-01: Number 
of Loans and Gross Commitments. Washington, D.C.: U.S. Department of Education, 2001. 

Description 

Federal loans comprise more than 90% of the funds students borrow to attend college. As such, 
this indicator serves as a proxy for annual student loan burden. The following formula is used to 
calculate the average loan amount students receive from the federal government: 

■ Numerator: (Total dollars in FFELP Stafford subsidized, unsubsidized, and PLUS 
loans made to parents in AY 2001) + (total dollars in William D. Ford Stafford 
subsidized, unsubsidized, and PLUS loans made to students in AY 2001). 

■ Denominator: Total number of loans from both programs. 



The methodology for this measure has been refined. Beginning with Measuring Up 2002, this 
indicator reports the average loan amount borrowed by undergraduate students only. However, 
data are still unavailable for the number of recipients by state. For this reason, the denominator 
used may report individual students who receive more than one loan, understating the total 
average loan amount. 

Data availability 

Data are available for all 50 states. 
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D. Completion 



The five indicators in the completion category are based on two overall concepts; persistence 
from the first to the second year of college, and completion of certificates and degrees in a timely 
manner. 



Completion: Indicators and Weights 


Indicator 


Weight 


Cluster 1; Persistence 


20% 


1 st year community college students returning their 2"^ year 


10% 


Freshmen at 4-year colleges/universities returning their sophomore year 


10% 


Cluster 2; Completion 


80% 


First-time, full-time students completing a bachelor’s degree within 5 years of high school 
completion 


15% 


First-time, full-time students completing a bachelor’s degree within 6 years of college entrance 


15% 


Certificates, degrees, and diplomas awarded at all colleges and universities per 100 undergraduate 
students 


50% 



BEST COPY AVAILABLE 




PERSISTENCE: 

1®^ year community college students returning their 2"^* year 

Source 

ACT. “Institutional Data Questionnaire, Fall 2000,” unpublished analysis conducted by ACT, 
Iowa City, Iowa, 2001. 

Description 

Using data from the ACT national survey of 3,415 postsecondary institutions, this indicator 
calculates a weighted mean rate of first-to-second-year persistence for first-time, full-time 
students enrolled in a technical or community college. The weighted mean rate for states is based 
on the total first-time, full-time student enrollment of responding institutions. 

Notes 

Since part-time students are not included in the calculations, persistence rates for states with high 
part-time student enrollment may be overestimated. Furthermore, the data are reported at the 
institutional level and do not track student transfer. For this reason, the persistence rate may 
underestimate systemwide persistence if students transfer from one institution to another in the 
same state. 

Data availability 

The most recent 2000 survey provides data for 41 states. Regarding the 9 states for which there 
are no data, they either: did not respond (Alaska), have a small sample size (Idaho, Nevada, 

Rhode Island, and Vermont), or have a large standard error (Montana, North Dakota, South 
Dakota, and Utah). Using the latest data available method, however, Nevada’s and Utah’s figures 
from the earlier survey are reported in Measuring Up 2002. Altogether, data are reported for 43 
states. 
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PERSISTENCE: 

Freshmen at 4-year colleges/universities returning their sophomore year 

Source 

ACT. “Institutional Data Questionnaire, Fall 2000,” unpublished analysis conducted by ACT, 
Iowa City, Iowa, 2001. 

Description 

Using data from the ACT national survey of 3,415 postsecondary institutions, this indicator 
calculates a weighted mean rate of first-to-second-year persistence for first-time, full-time 
students enrolled in a public or private four-year institution. The weighted mean rate for states is 
based on the total first-time, full-time student enrollment of responding institutions. 

Notes 

As with the measure of students returning at community colleges, part-time students are not 
included in the calculations. Therefore, persistence rates for states with high part-time student 
enrollment may be overestimated, and this measure may underestimate systemwide persistence if 
students transfer from one institution to another in the same state. 

Data availability 

Data are available for all states except Alaska; Alaska’s estimate is not reliable due to the large 
standard error. 
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COMPLETION: 

First-time, full-time students completing a bachelor’s degree within 5 years of high 
school completion 

Source 

ACT. “Institutional Data Questionnaire, Fall 2000,” unpublished analysis conducted by ACT, 
Iowa City, Iowa, 2001. 

Description 

Using data from the ACT national survey of 3,415 postsecondary institutions, this indicator 
measures the proportion of students in a public or private four-year institution who ultimately 
complete the baccalaureate degree within five years after high school at the same institution that 
they entered. The data represent the graduates who completed their degree during the 1999-2000 
academic year. The reported rate is the weighted mean rate based on the total first-time, full-time 
student enrollment of responding institutions. 

Note 

Part-time, transfer, and returning students are not captured in this measure. 

Data availability 

The fall 2000 survey provided data for all 50 states. However, due to the large standard error, 
Delaware’s figure comes from the earlier survey used in Measuring Up 2000. 
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COMPLETION: 

First-time, full-time students completing a bachelor’s degree within 6 years of 
college entrance 

Source 

National Center for Educational Statistics. Graduation Rate Survey, 1998-99 (preliminary data, 
Peer Analysis System). Washington, D.C.: U.S. Department of Education, http://www.ed.gov 
(accessed 6/15/02). 

Description 

Older adults and students working full-time make up a larger proportion of the college student 
body today, and more students now take longer to complete the baccalaureate degree. 

Considering such trends, this new measure is introduced to look at a prolonged time period within 
which students progress toward the bachelor’s degree. Using preliminary data from the NCES 
Graduation Rate Survey (GRS), this indicator measures the proportion of first-time, full-time 
students enrolled in a public or private four-year institution who obtain the bachelor’s degree at 
the institution they entered within six years of enrolling. The students captured in the data are 
those who entered in fall 1993 and graduated during the 1998-99 academic year. 

Variables used from GRS and Institutional Characteristics Files: 

■ Title ly eligibility: opeflag = 1 

■ Four-year institutions: iclevel = 1 

■ Participation in GRS: complSO > 0 

■ State summaries: adjcoh complSO by stabbr 

The calculation is based on the following procedure: The 1999 institutional characteristics 
file and the 1999 graduation rate file were downloaded from the on-line IPEDS Peer Analysis 
System and merged as an SPSS program file. From the resulting file. Title FV-eligible, degree- 
granting, four-year institutions that reported the number of students who completed within 150% 
of the allotted time are selected. The total number in the adjusted cohort and the total number of 
students who completed within 150% of the allotted time are then reported by state. The numbers 
reflect the sum of all students across institutions. The final graduation rate is calculated by 
dividing the number of students who completed within 150% of the allotted time by the total 
number of the adjusted cohort. 

Notes 

As with the five-year graduation rates, part-time, returning, and transfer students are not captured 
in this measure. 
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NCES states that the data from the Peer Analysis System should not be used for aggregate 
estimates. However, analysis by the National Center staff and review by the advisory group 
suggest that available data are sufficiently robust to make state-level estimates. 

Data availability 

Data are available for all 50 states. 
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COMPLETION: 

Certificates, degrees, and diplomas awarded at all colleges and universities per 100 
undergraduate students 

Sources 
Total awards 

National Center for Education Statistics. Completion Survey, 1999-2000. Washington, D.C.: U.S. 
Department of Education, 2002. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Undergraduate enrollments 

National Center for Education Statistics. Fall Enrollment Survey, 1999-2000. Washington, D.C.: 
U.S. Department of Education, 2002. State-level data provided by Pinkerton Computer 
Consultants, 2002. 

Description 

This indicator uses the following calculation: 

■ Numerator: Total number of associate’s degrees, baccalaureate degrees, certificates, 
and diplomas awarded throughout the 1999-2000 academic year. 

■ Denominator: Part- and full-time undergraduate enrollment in fall 1999. 



Note 

This measure is not a cohort statistic. However, since both associate’s and bachelor’s degrees are 
totaled, this indicator does capture the students transferring from one institution to another. 

Data availability 

Data are available for all 50 states. 
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E. Benefits 



In exchange for its investment in higher education, each state expects to have a more productive 
workforce, a more informed electorate, and a better functioning society. In addition to these 
public benefits, each state expects that having more highly educated residents will lead to 
increased private benefits, such as higher lifetime earnings. 

Specifically, this category considers the states’ investments in human capital in relation to 
four critical concepts: 

■ Educational Achievement 

■ Economic Benefits 

■ Civic Benefits 

■ Adult Skill Levels 

Geographic and demographic factors that may impact the returns on a state’s education 
investment are not considered in this category, because of data limitations. 



Benefits; Indicators and Weights 



Benefits; Indicators and Weights 


Weight 


Cluster 1: Educational Achievement 


30% 


Population ages 25 to 65 with bachelor’s degree or higher 


30% 


Cluster 2: Economic Benefits 


25% 


Increase in total personal income as a result of the percentage of the population holding a 
bachelor’s degree 


15% 


Increase in total personal income as a result of the percentage of the population with some 
college (including an associate’s degree), but not a bachelor's degree 


10% 


Cluster 3: Civic Benefits 


25% 


Residents voting in 1998 and 2000 national elections 


12.5% 


Of those who itemize on federal income taxes, the percentage declaring charitable gifts 


12.5% 


Cluster 4: Adult Skill Levels 


20% 


Adults demonstrating high-level quantitative literacy skills 


6.7% 


Adults demonstrating high-level prose literacy skills 


6.7% 


Adults demonstrating high-level document literacy skills 


6.6% 


BEST COPY AVAILABLE 
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EDUCA TIONAL A CHIEVEMENT: 

Population ages 25 to 65 with bachelor’s degree or higher 

Source 

U.S. Bureau of the Census. Current Population Survey, October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Description 

This measure assesses the educational attainment of the working-age population, using the 
following calculation: 

■ Numerator: Number of adults ages 25 to 65 with at least a baccalaureate degree. 

■ Denominator: Number of adults ages 25 to 65 in the state’s population. 



Notes 

This indicator averages three years of the most current data, 1998 to 2000, to account for 
aberrations in any single year of data. This indicator does not control for interstate migration. 
State scores may be higher due to the number of bachelor’s degree holders who have migrated 
from other states. 

Data availability 

Data are available for all 50 states. 
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ECONOMIC BENEFITS: 

Increase in total personal income as a result of the percentage of the population 
holding a bachelor^s degree 

Sources 

Median earnings 

U.S. Bureau of the Census. Current Population Survey^ March 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Total population with bachelor’s degree or higher 

U.S. Bureau of the Census. Current Population Survey^ October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Total personal income 

Bureau of Economic Analysis. State Personal Income, Annual and Quarterly, for All States and 
Regions 1999. Washington, D.C.: U.S. Department of Commerce. 
http://www.bea.doc.gov/bea/regional/spi (accessed 4/1/02). 

Description 

This indicator reflects the average net contribution of baccalaureate degree holders relative to 
total personal income. This indicator is measured through a three-step formula. First, this measure 
calculates the difference in the median earnings between adults whose highest level of education 
is a high school credential and adults with at least a baccalaureate degree. This earnings 
differential is then multiplied by the number of adults in the state with a baccalaureate degree. 

The third step divides this result by total personal income in the state. The following formula is 
used: 

■ Numerator: [(Median earnings of population ages 25 to 65 with at least a 
baccalaureate degree) - (median earnings of population ages 25 to 65 whose highest 
education is a high school credential)] X (the number of adults ages 25 to 65 with at 
least a baccalaureate degree). 

■ Denominator: Total personal income in the state. 

Notes 

Personal income is the sum of net earnings adjusted by place of residence, rental income of 
persons, personal dividend income, personal interest income, and transfer payments. It is 
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measured before the deduction of personal income taxes and other personal taxes and is reported 
in current dollars (no adjustment is made for price changes). Total personal income is the 
personal income received by all residents of a state from participation in production, government 
and business transfer payments, and accumulated government interest. 

Earnings of adults who are unemployed or not in the labor force but who have minimal 
annual earnings are included in the calculation of this measure. 

Data availability 

For earnings and population, this indicator averages three years of the most current data, 1998 to 
2000, in order to obtain a large enough sample size to make reliable state estimates and to account 
for aberrations in any single year of data. Data for each state’s total personal income represent a 
single year. 

Data are available for all 50 states. 
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ECONOMIC BENEFITS: 

Increase in total personal income as a result of the percentage of the population with some 
college (including an associate’s degree), but not a bachelor’s degree 



Sources: 

Median earnings 

U.S. Bureau of the Census. Current Population Survey^ March 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Total population with some college or an associate's degree 

U.S. Bureau of the Census. Current Population Survey, October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Total personal income 

Bureau of Economic Analysis. State Personal Income, Annual and Quarterly , for All States and 
Regions 1999. Washington, D.C.: U.S. Department of Commerce. 
http://www.bea.doc.gov/bea/regional/spi (accessed 4/1/02). 

Description 

Similar to the economic benefits attributed to the population with a bachelor’s degree, this new 
indicator approximates statewide income benefits associated with those whose highest education 
attained is higher than a high school credential, but lower than a bachelor’s degree. It includes 
those holding an associate’s degree or those who attended some type of postsecondary institution 
but did not obtain the baccalaureate degree. The same three-step calculation was applied. 

First, the difference in the median earnings between adults whose highest level of 
education is a high school credential and adults with some college (including an associate’s but 
not a bachelor’s degree) is calculated. This earnings differential is then multiplied by the number 
of adults in the state with some college (including an associate’s but not a bachelor’s degree). The 
third step divides this result by total personal income in the state. The following formula is used: 

■ Numerator: [(Median earnings of population ages 25 to 65 with some college or an 
associate’s degree) - (median earnings of population ages 25 to 65 whose highest 
education is a high school credential)] X (the number of adults ages 25 to 65 with 
some college or an associate’s degree). 

■ Denominator: Total personal income in the state. 
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Notes 



Personal income is the sum of net earnings adjusted by place of residence, rental income of 
persons, personal dividend income, personal interest income, and transfer payments. It is 
measured before the deduction of personal income taxes and other personal taxes and is reported 
in current dollars (no adjustment is made for price changes). Total personal income is the 
personal income received by all residents of a state from participation in production, government 
and business transfer payments, and accumulated government interest. 

Earnings of adults who are unemployed or not in the labor force but who have minimal 
annual earnings are included in the calculation of this measure. 

Data availability 

For earnings and population, this indicator averages three years of the most current data, 1998 to 
2000, in order to obtain a large enough sample size to make reliable state estimates and to account 
for aberrations in any single year of data. Data for each state’s total personal income represent a 
single year. 

Data are available for all 50 states. 
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CIVIC BENEFITS: 

Residents voting in 1998 and 2000 national elections 

Source 

U.S. Bureau of the Census. Current Population Survey, November Voting and Registration, 1998 
& 2000. Washington, D.C. http://www.census.gov (accessed 6/14/02). 

Description 

The following calculation is used: 

■ Numerator: (Number of voters in November 1998 election) + (number of voters in 
2000 election). 

■ Denominator: (Voting population* in 1998) + (voting population in 2000). 

* Voting population indicates state residents age 18 or above. 



Notes 

Votes cast in local, state, and federal races are included. Due to data limitations, this indicator 
does not disaggregate the voting rates of residents by level of educational attainment. National 
studies have shown that voting rates increase with higher levels of educational attainment. This 
measure is included as a proxy for the civic returns a state enjoys as a result of having a more 
highly educated population. 

Data availability 

Data are available for all 50 states. 
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CIVIC BENEFITS: 

Of those who itemize on federal income taxes, the percentage declaring charitable 
gifts 

Source 

Internal Revenue Service. Statistics of Income for Tax Year 2000. Annual State Tax Reports. 
Washington, D.C.: U.S. Department of the Treasury, http://www.irs.ustreas.gov/pub/irs- 
soi/00in54cm.exe (accessed 5/6/02). 

Description 

The charitable giving rate is the number of tax filers who made charitable contributions compared 
to all those who itemized their tax returns for the 2000 tax year. 

■ Numerator: Number of tax filers itemizing charitable contributions on their 2000 
federal tax return. 

■ Denominator: Number of state residents filing an itemized federal tax return for 

2000. 

Notes 

By monitoring the number of donors rather than the dollar amount donated, this indicator 
captures the prevalence of philanthropy among income earners and tax filers in the state. The 
number of donors in the state serves as a proxy for residents’ local and regional dollar 
commitments to public welfare. 

Due to data limitations, this indicator does not disaggregate the charitable giving rates of 
residents by level of educational attainment. Annual analyses by the Washington, D.C. -based 
Independent Sector correlate income to volunteering and describe a direct relationship between 
educational attainment and charitable giving. 

The indicator may favor states with wealthier populations because only those donations 
large enough to meet tax -deductible criteria are reported. 

Data availability 

Data are available for all 50 states. 
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ADULT SKILL LEVELS: 

Adults demonstrating high-level quantitative literacy skills 

Source 

National Center for Education Statistics. National Adult Literacy Survey, 1992. Washington, 
D.C.: U.S. Department of Education, 1994. Collecting agency: Educational Testing Service. 
Special analysis for non-oversample states by Stephen Reder, Portland State University. 

Description 

This indicator measures the percentage of the states’ populations whose literacy skills are most 
similar to the skills of college graduates (level 4 or 5 on a scale of 1 to 5 on the National Adult 
Literacy Survey, NALS). 

Quantitative literacy measures the knowledge and skills required to apply arithmetic 
operations, either alone or sequentially, using numbers embedded in printed materials. Adults 
with the highest measured level of quantitative literacy, level 5, can perform multiple arithmetic 
operations sequentially, and can make inferences about the appropriate operation to perform 
without prompting from the text. 

Notes 

Due to data limitations, this indicator does not disaggregate the literacy rates of residents by level 
of educational attainment. Nevertheless, national studies have shown that literacy is attained 
through, and associated with, higher levels of educational attainment. 

Data availability 

Eleven states participated in an oversample of the NALS: California, Illinois, Indiana, Iowa, 
Louisiana, New Jersey, New York, Ohio, Pennsylvania, Texas, and Washington. For some states 
not participating in the oversample, estimates could be calculated using multivariate regression 
techniques. Multivariate modeling relied on 1990 census data to predict literacy levels, given 
demographic and economic data. These results were compared with jackknife estimations of the 
NALS sample using the 60 replicate weights provided by NALS, and were found to be fairly 
predictive. As a result of these efforts, data are available for 28 states. 

States for which data are unavailable are: Alabama, Alaska, Connecticut, Hawaii, 
Kentucky, Maine, Maryland, Minnesota, Mississippi, Montana, Nebraska, New Hampshire, New 
Mexico, North Dakota, Oregon, Rhode Island, South Carolina, South Dakota, Utah, Vermont, 
Virginia, and Wyoming. 
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ADULT SKILL LEVELS: 

Adults demonstrating high-level prose literacy skills 

Source 

National Center for Education Statistics. National Adult Literacy Survey, 1992. Washington, 

D.C.: U.S. Department of Education, 1994. Collecting agency: Educational Testing Service. 
Special analysis for non-oversample states by Stephen Reder, Portland State University. 

Description 

This indicator measures the percentage of the states’ populations whose literacy skills are most 
similar to the skills of college graduates (level 4 or 5 on a scale of 1 to 5 on the National Adult 
Literacy Survey, NALS). 

Prose literacy measures the knowledge and skills needed to understand and use information 
from texts that include editorials, news stories, poems, and fiction. Adults with the highest 
measured level of prose literacy, level 5, can find information in dense text with considerable 
distracting information that might seem plausible but is incorrect. 

Notes 

Due to data limitations, this indicator does not disaggregate the literacy rates of residents by level 
of educational attainment. Nevertheless, national studies have shown that literacy is attained 
through, and associated with, higher levels of educational attainment. 

Data availability 

Eleven states participated in an oversample of NALS: California, Illinois, Indiana, Iowa, 
Louisiana, New Jersey, New York, Ohio, Pennsylvania, Texas, and Washington. For some states 
not participating in the oversample, estimates could be calculated using multivariate regression 
techniques. Multivariate modeling relied on 1990 census data to predict literacy levels, given 
demographic and economic data. These results were compared with jackknife estimations of the 
NALS sample using the 60 replicate weights provided by NALS, and were found to be fairly 
predictive. As a result of these efforts, data are available for 28 states. 

States for which data are unavailable are: Alabama, Alaska, Connecticut, Hawaii, 
Kentucky, Maine, Maryland, Minnesota, Mississippi, Montana, Nebraska, New Hampshire, New 
Mexico, North Dakota, Oregon, Rhode Island, South Carolina, South Dakota, Utah, Vermont, 
Virginia, and Wyoming. 
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ADULT SKILL LEVELS: 

Adults demonstrating high-level document literacy skills 

Source 

National Center for Education Statistics. National Adult Literacy Survey, 1992, Washington, 
D.C.: U.S. Department of Education, 1994. Collecting agency: Educational Testing Service. 
Special analysis for non-oversample states by Stephen Reder, Portland State University. 

Description 

This indicator measures the percentage of the states’ populations whose literacy skills are most 
similar to the skills of college graduates (level 4 or 5 on a scale of 1 to 5 on the National Adult 
Literacy Survey, NALS). 

Document literacy measures the knowledge and skills required to locate and use 
information contained in materials that include job applications, payroll forms, transportation 
schedules, maps, tables, and graphs. Adults with the highest measured level of document literacy, 
level 5, can use complex documents containing distracting information and make high-level 
inferences. 

Notes 

Due to data limitations, this indicator does not disaggregate the literacy rates of residents by level 
of educational attainment. Nevertheless, national studies have shown that literacy is attained 
through, and associated with, higher levels of educational attainment. 

Data availability 

Eleven states participated in an oversample of NALS: California, Illinois, Indiana, Iowa, 
Louisiana, New Jersey, New York, Ohio, Pennsylvania, Texas, and Washington. For some states 
not participating in the oversample, estimates could be calculated using multivariate regression 
techniques. Multivariate modeling relied on 1990 census data to predict literacy levels, given 
demographic and economic data. These results were compared with jackknife estimations of the 
NALS sample using the 60 replicate weights provided by NALS, and were found to be fairly 
predictive. As a result of these efforts, data are available for 28 states. 

States for which data are unavailable are: Alabama, Alaska, Connecticut, Hawaii, 
Kentucky, Maine, Maryland, Minnesota, Mississippi, Montana, Nebraska, New Hampshire, New 
Mexico, North Dakota, Oregon, Rhode Island, South Carolina, South Dakota, Utah, Vermont, 
Virginia, and Wyoming. 
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F. Learning 



Assessing student learning in college is perhaps the most important criterion for measuring 
success in higher education. Despite assessment activities in many states, however, there are no 
common benchmarks for student learning that would allow meaningful state-to-state 
comparisons. Therefore, Measuring Up 2002, like Measuring Up 2000, gives all states an 
Incomplete in this performance category. 

However, recent efforts to develop better measures of college-level learning are promising. 
To learn more about these efforts, see the following articles in Measuring Up 2002: 

■ ''Measuring Up and Student Learning,” by Margaret A. Miller (pp. 69-72). 

■ “Grading Student Learning: You Have to Start Somewhere,” by Peter T. Ewell 
(pp. 73-76). 

■ “Constructing Indicators: A Proposal for Discussion” (pp. 77-78). 

■ “Kentucky: Sample Index Scores for Measures of Education Capital” (p. 79). 



III. Non-Graded Measures 



A. Performance Gaps 

Performance gaps measure various gaps in performance — by gender, ethnicity, family income, 
and/or level of parental education — for indicators presented in Measuring Up 2002. The 
following list details the indicators and the sources for which data about performance gaps are 
available. 

Preparation: 18- to 24-year-olds with a high school credential 

By ethnicity 
By gender 
By family income 
By parental education level 

U.S. Bureau of the Census. Current Population Survey, October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Preparation: 9“* to 12“* graders taking at least one upper-level math course 

By ethnicity 

Rolf K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 
2001: State-by-State Trends and New Indicators from the 1999— 2000 School Year. Table 17; 
“Race/Ethnic Differences in Students Taking Chemistry and Algebra 2/Integrated Math 3.” 
Washington, D.C.: Council of Chief State School Officers, 2002, p. 49. 

Preparation: 9^^ to 12^^ graders taking at least one upper-level science course 

By ethnicity 

Rolf K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 
2001: State-by-State Trends and New Indicators from the 1999-2000 School Year. Table 17: 
“Race/Ethnic Differences in Students Taking Chemistry and Algebra 2/Integrated Math 3.” 
Washington, D.C.: Council of Chief State School Officers, 2002. p. 49. 
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Participation: 18- to 24-year-olds enrolling in college 

By gender 
By ethnicity 
By family income 
By parental education level 

U.S. Bureau of the Census. Current Population Survey, October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Completion: Certificates, degrees, and diplomas awarded at all colleges and 
universities per 100 undergraduate students 

By ethnicity 
Total awards 

National Center for Education Statistics. Completion Survey, 1999-2000. Washington, D.C.: U.S. 
Department of Education, 2002. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Undergraduate enrollments 

National Center for Education Statistics. Fall Enrollment Survey, 1999-2000. Washington, D.C.: 
U.S. Department of Education, 2002. State-level data provided by Pinkerton Computer 
Consultants, 2002. 

Benefits: Population aged 25 to 65 with bachelor’s degree or higher 
By ethnicity 

U.S. Bureau of the Census. Current Population Survey, October 1998, 1999, and 2000 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 

Benefits: Net loss revenue (2000) 

Net loss revenue measures the loss in annual earnings and annual tax revenues due to the earnings 
gaps between ethnic minorities and non-Hispanic whites who have equal levels of educational 
attainment. This loss of earnings is measured relative to total personal income in a state. 

Population and earnings differential 

U.S. Bureau of the Census, Current Population Survey, March: Annual Demographic File, 1999— 
2001 [Computer file]. Washington, D.C.: 2001. Calculations by David W. Wright, Associate 




Professor of Sociology, Wichita State University, Wichita, Kansas. Due to small sample size, data 
are not available for Maine, New Hampshire, North Dakota, South Dakota, Vermont, and 
Wyoming. 

Total personal income 

Bureau of Economic Analysis. Annual State Personal Income, 2000. Washington, D.C.: U.S. 
Department of Commerce, http://www.bea.gov/ (accessed 5/9/02). 



B. Change over Time 

This information about change over time complements the graded categories by providing states 
with a means for measuring progress over 10 years. The long-term change data are available for 
the following five indicators: 

Preparation: 18- to 24-year-olds with a high school credential (1989 to 1999) 

U.S. Bureau of the Census. Current Population Survey j October 1988, 1989, 1990, 1998, 1999, 
and 2000 Supplements. Washington, D.C. State-level data provided by Pinkerton Computer 
Consultants, 2002. 

Preparation: 9^** to 12^** graders taking at least one upper-level math course (1990 to 
2000) 

Rolf K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 
2001: State-by-State Trends and New Indicators from the 1999-2000 School Year. Washington, 
D.C.: Council of Chief State School Officers, 2002, p. 43. 

Preparation: 9^** to 12^** graders taking at least one upper-level science course (1990 
to 2000) 

Rolf K. Blank and Doreen Langesen. State Indicators of Science and Mathematics Education 
2001: State-by-State Trends and New Indicators from the 1999-2000 School Year. Washington, 
D.C.: Council of Chief State School Officers, 2002, p. 44. 

Participation: 18- to 24-year-olds enrolling in college (1989 to 1999) 

U.S. Bureau of the Census. Current Population Survey, October 1988, 1989, 1990, 1998, 1999, 
and 2000 Supplements. Washington, D.C. State-level data provided by Pinkerton Computer 
Consultants, 2002. 
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Benefits: Population aged 25 to 65 with bachelor’s degree or higher (1989 to 1999) 

U.S. Bureau of the Census. Current Population Survey, October 1988, 1989, 1990, 1998, 1999, 
and 2000 Supplements. Washington, D.C. State-level data provided by Pinkerton Computer 
Consultants, 2002. 

C. State Context 
P opulation (2001) 

U.S. Bureau of the Census. State Population Estimates, 2001. Time Series of State Population 
Estimates, Table ST-2001EST-01. Washington, D.C. http://www.census.gov/ (accessed 5/29/02). 

Gross state product (1999) 

Bureau of Economic Analysis. Gross State Product for States. Regional Accounts Data. 
Washington, D.C.: U.S. Department of Commerce, 2001. http://www.bea.gov/ (accessed 

snmi). 

D. Leading Indicators 

Projected % change in population (2000-2015) 

U.S. Bureau of the Census. Population Projections for States, 1995—2025. Washington, D.C.: 
1999. 

Projected % change in number of all high school graduates (1998-2010) 

Western Interstate Commission for Higher Education. Knocking at the College Door: Projections 
of High School Graduates by State and Race/Ethnicity, 1996—2012. Boulder, CO: 1998. 

Projected budget surplus/shortfall by 2008 

Harold Hovey. State Spending for Higher Education in the Next Decade: The Battle to Sustain 
Current Support. San Jose, CA: National Center for Public Policy and Higher Education, 1999. 

Average income of poorest 20% of population (2000) 

U.S. Bureau of the Census. Current Population Survey, March 1999, 2000, and 2001 
Supplements. Washington, D.C. State-level data provided by Pinkerton Computer Consultants, 
2002. 




55 



Children in poverty (2000) 

Annie Casey Foundation. Kids Count. Baltimore, MD: 2002. 
http://www.aecf.org/kidscount/c2ss/pdfs/entire_book.pdf (accessed 5/14/02). 

Percent of population with less than a high school diploma or equivalent (2000) 

U.S. Bureau of the Census. Current Population Survey, March 2000 Supplement. Washington, 
D.C. http://www.census.gov/population/socdemo/education/p20-536/tablel 3.pdf (accessed 
7/19/02). 

New economy index (2002) 

Progressive Policy Institute. The State New Economy Index. Washington, D.C.: 2002. 
http://www.neweconomyindex.org/states/2002/overall_rank.html (accessed 6/14/02). 



E. Facts and Figures 

Institutions of postsecondary education (2000-01) 

Students enrolled by institution type (1999) 

Students enrolled by level (1999) 

Enrollment status of students (1999) 

Net migration of students (1998) 

Average tuition (2000-01) 

National Center for Education Statistics. Digest of Education Statistics, 2001. Washington, D.C.: 
U.S. Department of Education, 2002. http://nces.ed.gov/pubs2002/digest2001/ (accessed 
5/29/02). 

General Education Development (GED) diploma 

Number of GED diplomas issued to young adults, ages 16 to 24 

General Educational Development Testing Service of the American Council on Education. Who 
Took the GED? GED 2001 Statistical Report. Washington, D.C.: American Council on 
Education, 2002. 

Number of high school graduates in 2000-01 

Western Interstate Commission for Higher Education. Knocking at the College Door: Projections 
of High School Graduates by State and Race/Ethnicity, 1996—2012. Boulder, CO: 1998. 
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State and local appropriations for higher education 

Center for Higher Education & Finance. Grapevine: A National Database of Tax Support for 
Higher Education. Normal, IL: Illinois State University. Per $1,000 personal income and per 
capita (FY 2001) data are from http://www.coe.ilstu.edu/grapevine/tablelO.html (accessed 
5/28/02). Data for percentage change in state appropriations (FY 1992 to FY 2002) are from 
http://www.coe.ilstu.edu/grapevine/table3.html (accessed 5/28/02). 

F. Share of State Appropriations Chart 

National Association of State Budget Officers, State Expenditure Report, 1990 and 2000 editions. 
Washington, D.C.: 1991,2001. 

G. Ethnic Distribution Chart 
S tate population (1999) 

U.S. Bureau of the Census. Population Estimates for States by Race and Hispanic Origin, July 1, 
1999. Washington, D.C. Table ST-99-32, http://www.census.gov/ (accessed 5/29/02). 

Students enrolled in higher education (1999) 

National Center for Education Statistics. Digest of Education Statistics, 2001. Washington, D.C.: 
U.S. Department of Education, 2002. Table 211. http://nces.ed.gov/pubs2002/digest2001/ 
(accessed 5/29/02). 
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The National Center for Public Policy and Higher Education 



The National Center for Public Policy and Higher Education promotes public policies that 
enhance Americans’ opportunities to pursue and achieve high-quality education and training 
beyond high school. As an independent, nonprofit, nonpartisan organization, the National Center 
prepares action-oriented analyses of pressing policy issues facing the states and the nation 
regarding opportunity and achievement in higher education — including two- and four-year, public 
and private, for-profit and nonprofit institutions. The National Center communicates performance 
results and key findings to the public, to civic, business, and higher education leaders, and to state 
and federal leaders who are poised to improve higher education policy. 

Established in 1998, the National Center is not affiliated with any institution of higher 
education, with any political party, or with any government agency; it receives continuing, core 
financial support from a consortium of national foundations that includes The Pew Charitable 
Trusts, The Atlantic Philanthropies, and The Ford Foundation. 
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152 North Third Street, Suite 705, San Jose, California 95112 
Telephone: 408-271-2699 • FAX: 408-271-2697 

www.highereducation.org 



National Center Publications 

The National Center publishes: 

★ Reports and analyses commissioned by the National Center, 

★ Reports and analyses written by National Center staff, 

★ National Center Policy Reports that are approved by the National Center’s Board of 
Directors, and 

★ CrossTalk, a quarterly publication. 

The following National Center publications — as well as a host of other information and 
links — are available at www.highereducation.org. Single copies of most of these reports are also 
available from the National Center. Please FAX requests to 408-271-2697 and ask for the report 
by publication number. Measuring Up 2000 and Measuring Up 2002 are available by calling 888- 
269-3652. 

Measuring Up 2002: The State-byState Report Card for Higher Education (October 2002, #02-7). This 
report card, which updates the inaugural edition released in 2000, grades each state on its performance in 
five key areas of higher education. Measuring Up 2002 also evaluates each state’s progress in relation to its 
own results two years ago. Visit www.highereducation.org to download Measuring Up 2002 or to make 
your own comparisons of state performance in higher education. Printed copies are available for $25.00 by 
calling 888-269-3652 (discounts available for large orders). 

Technical Guide Documenting Methodology, Indicators and Data Sources for Measuring Up 
2002 (October 2002, #02-8). 
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State Policy and Community College-Baccalaureate Transfer, by Jane V. Wellman (July 2002, #02-6). 
Recommends state policies to energize and improve higher education performance regarding transfers from 
community colleges to four-year institutions. 

Fund for the Improvement of Postsecondary Education: The Early Years (June 2002, #02-5). The Fund 
for the Improvement of Postsecondary Education (FIPSE) attained remarkable success in funding 
innovative and enduring projects during its early years. This report, prepared by FIPSE’s early program 
officers, elaborates on how those results were achieved. 

Losing Ground: A National Status Report on the Affordability of American Higher Education (May 
2002, #02-3). This national status report documents the declining affordability of higher education for 
American families, and highlights public policies that support affordable higher education. Provides state- 
by-state summaries as well as national findings. 

The Affordability of Higher Education: A Review of Recent Survey Research, by John 
Immerwahr (May 2002, #02-4). This review of recent surveys by Public Agenda confirms that 
Americans feel that rising college prices threaten to make higher education inaccessible for many 
people. 

Coping with Recession: Public Policy, Economic Downturns and Higher Education, by Patrick M. 

Callan (February 2002, #02-2). Outlines the major policy considerations that states and institutions of 
higher education face during economic downturns. 

Competition and Collaboration in California Higher Education, by Kathy Reeves Bracco and Patrick M. 
Callan (January 2002, #02-1). Argues that the structure of California’s state higher education system limits 
the system’s capacity for collaboration. 

Measuring Up 2000: The State-by-State Report Card for Higher Education (November 2000, #00-3). 

This first-of-its-kind report card grades each state on its performance in higher education. The report card 
also provides comprehensive profiles of each state and brief states-at-a-glance comparisons. Visit 
www.hlghereducation.org to download Measuring Up 2000 or to make your own comparisons of state 
performance in higher education. Printed copies are available for $25.00 by calling 888-269-3652 
(discounts available for large orders). 

Beneath the Surface: A Statistical Analysis of the Major Variables Associated with State Grades 
in Measuring Up 2000, by Alisa F. Cunningham and Jane V. Wellman (November 2001, #01-4). 
Using statistical analysis, this report explores the “drivers” that predict overall performance in 
Measuring Up 2000. 

Supplementary Analysis for Measuring Up 2000; An Exploratory Report, by Mario Martinez 
(November 2001, #01-3). Explores the relationships within and between the performance 
categories in Measuring Up 2000. 

Some Next Steps for States: A Follow-up to Measuring Up 2000, by Dennis Jones and Karen 
Paulson (June 2001, #01-2). Suggests a range of actions that states can take to bridge the gap 
between state performance identified in Measuring Up 2000 and the formulation of effective 
policy to improve performance in higher education. 

A Review of Tests Performed on the Data in Measuring Up 2000, by Peter Ewell (June 2001, 
#01-1). Describes the statistical testing performed on the data in Measuring Up 2000 by the 
National Center for Higher Education Management Systems. 
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Recent State Policy Initiatives in Education: A Supplement to Measuring Up 2000, by Aims 
McGuinness, Jr. (December 2000, #00-6). Highlights education initiatives that states have adopted 
since 1997-98. 

Assessing Student Learning Outcomes: A Supplement to Measuring Up 2000, by Peter Ewell 
and Paula Ries (December 2000, #00-5). National survey of state efforts to assess student learning 
outcomes in higher education. 

Technical Guide Documenting Methodology, Indicators and Data Sources for Measuring Up 
2000 (November 2000, #00-4). 

A State-by-State Report Card on Higher Education: Prospectus (March 2000, #00-1). 
Summarizes the goals of the National Center’s report card project. 

Great Expectations: How the Public and Parents — IVhite, African American and Hispanic — View 
Higher Education, by John Immerwahr with Tony Foleno (May 2000, #00-2). This report by Public 
Agenda finds that Americans overwhelmingly see higher education as essential for success. Survey results 
are also available for the following states: 

Great Expectations: How Pennsylvanians View Higher Education (May 2000, #00-2b) 

Great Expectations: How Floridians View Higher Education (August 2000, #00-2 c) 

Great Expectations: How Coloradans View Higher Education (August 2000, #00 -2d) 

Great Expectations: How Californians View Higher Education (August 2000, #00-2 e) 

Great Expectations: How New Yorkers View Higher Education (October 2000, #00-2 f) 

Great Expectations: How Illinois Residents View Higher Education (October 2000, #00-2h) 

State Spending for Higher Education in the Next Decade: The Battle to Sustain Current Support, by 
Harold A. Hovey (July 1999, #99-3). This fiscal forecast of state and local spending patterns finds that the 
vast majority of states will face significant fiscal deficits over the next eight years, which will in turn lead 
to increased scrutiny of higher education in almost all states, and to curtailed spending for public higher 
education in many states. 

South Dakota: Developing Policy-Driven Change in Higher Education, by Mario Martinez (June 1999, 
#99-2). Describes the processes for change in higher education that government, business, and higher 
education leaders are creating and implementing in South Dakota. 

Taking Responsibility: Leaders* Expectations of Higher Education, by John Immerwahr (January 1999, 
#99-1). Reports the views of those most involved with decision-making about higher education, based on a 
survey and focus groups conducted by Public Agenda. 

The Challenges and Opportunities Facing Higher Education: An Agenda for Policy Research, by 
Dennis Jones, Peter Ewell, and Aims McGuinness (December 1998, #98-8). Argues that due to substantial 
changes in the landscape of postsecondary education, new state-level policy frameworks must be developed 
and implemented. 

Higher Education Governance: Balancing Institutional and Market Influences, by Richard C. 
Richardson, Jr., Kathy Reeves Bracco, Patrick M. Callan, and Joni E. Finney (November 1998, #98-7). 
Describes the structural relationships that affect institutional effectiveness in higher education, and argues 
that state policy should strive for a balance between institutional and market forces. 
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Federal Tuition Tax Credits and State Higher Education Policy: A Guide for State Policy Makers, by 
Kristin D. Conklin (December 1998, #98-6). Examines the implications of the federal income tax 
provisions for students and their families, and makes recommendations for state higher education policy. 

The Challenges Facing California Higher Education: A Memorandum to the Next Governor of 
California, by David W. Breneman (September 1998, #98-5). Argues that California should develop a new 
Master Plan for Higher Education. 

Tidal Wave II Revisited: A Review of Earlier Enrollment Projections for California Higher Education, 
by Gerald C. Hayward, David W. Breneman, and Leobardo F. Estrada (September 1998, #98-4). Finds that 
earlier forecasts of a surge in higher education enrollments were accurate. 

Organizing for Learning: The View from the Governor's Office, by James B. Hunt Jr., chair of the 
National Center for Public Policy and Higher Education, and former governor of North Carolina (June 
1 998, #98-3). An address to the American Association for Higher Education concerning opportunity in 
higher education. 

The Price of Admission: The Growing Importance of Higher Education, by John Immerwahr (Spring 
1998, #98-2). A national survey of Americans’ views on higher education, conducted and reported by 
Public Agenda. 

Concept Paper: A National Center to Address Higher Education Policy, by Patrick M. Callan (March 
1998, #98-1). Describes the purposes of the National Center for Public Policy and Higher Education. 
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